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Nonlinear Contraction Tools 
for Constrained Optimization 

Jonathan Soto and Jean- Jacques E. Slotine 

Abstract 

This paper describes new results linking constrained optimization theory and nonlinear contraction 
analysis. Generalizations of Lagrange parameters are derived based on projecting system dynamics on 
the tangent space of possibly time-varying constraints. The paper formalizes the intuition that, just as 
convexity rather than linearity is the key property in optimization, contraction rather than linearity is 
the key dynamical property in this context. 

Index Terms 

Nonlinear dynamics, nonlinear control, constrained optimization, Lagrange parameters, sliding con- 
trol, contraction analysis 

I. Introduction 

After presenting some initial examples that show the relations between contraction and opti- 
mization, we derive a contraction theorem for nonlinear systems with equality constraints. The 
method is applied to examples in differential geometry and biological systems. A new physical 
interpretation of Lagrange parameters is provided. In the autonomous case, we derive a new 
algorithm to solve minimization problems. Next, we state a contraction theorem for nonlinear 
systems with inequality constraints. Finally, we state another contraction theorem for nonlinear 
systems with time- varying equality constraints. A new generalization of time varying Lagrange 
parameters is given. In the autonomous case, we provide a solution for a new class of optimization 
problems, minimization with time-varying constraints. 

In the following we consider an n-dimensional time-varying system of the form: 

x(*)=f(x(*),t) (1) 
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where x G R n and t G R + and f is n x 1 nonlinear vector function which is assumed to be real 
and smooth in the sense that all required derivatives exist and are continuous. 

II. Preliminaries 

A. On contraction analysis 

Our results are based on nonlinear contraction theory [1], a viewpoint on incremental stability 
whose basic result we now recall. Historically, ideas closely related to contraction can be traced 
back to [24 j and even to Il25ll (see also Il26lh Il27lh and e.g. Il28ll for a more exhaustive list of 
related references). As pointed out in [lj, contraction is preserved through a large variety of 
systems combinations, and in particular it represents a natural tool for the study and design of 
nonlinear state observers, and by extension, of synchronization mechanisms Il29l . 

The basic result of contraction analysis can be stated as (for more details we refer to Q): 

Theorem 1. Denote by || the Jacobian matrix of f with respect to x. Assume that there exists 
a complex square matrix 0(x, t) such that the Hermitian matrix 0(x, t)* T 0(x, t) is uniformly 
positive definite, and the Hermitian part F# of the matrix 

F=(e + e|)e-> 

is uniformly negative definite. Then, all system trajectories converge exponentially to a single 
trajectory, with convergence rate | sup xt A max (F#)| > 0. The system is said to be contracting, F 
is called its generalized Jacobian, and 0(x, t)* T 0(x, t) its contraction metric. The contraction 
rate is the absolute value of the largest eigenvalue (closest to zero, although still negative) 
A |A max (F H )|. 

B. Optimization theory 

Optimization means finding "best available" values of some objective function given a defined 
domain, including a variety of different types of objective functions and different types of 
domains. We give the sufficient conditions for the point x* to be a minimum of a minimization 
problem. There are different classes of problems which are stated below, (for more details we 
refer to [0) 
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In unconstrained optimization we search for the minimum over the whole range of variables. 
The generic form is: 

min f7(x) (2) 
The second-order sufficient conditions in the unconstrained case are given by theorem [2j 

Theorem 2. Let U e C 2 (R n , R) be a function defined on a region in which the point x* is an 
interior point. Suppose in addition that 

VC/(x*) = and V 2 £7(x*) is positive definite 

x* is a solution of problem [2] 

In constrained optimization, the Karush-Kuhn-Tucker conditions (also known as the Kuhn- 
Tucker or KKT conditions) are sufficient for a solution in nonlinear programming to be optimal, 
provided that some regularity conditions are satisfied. The generic form is with m constraints is: 

min U(x) subject to (s.t) h(x) = (3) 

The second-order sufficient conditions in the constrained case are given by theorem |3j 

Theorem 3. Let U(x) e C 2 (R n ,R) and h(x) G C 2 (R n , R m ) be smooth functions and x* is a 
regular point (the columns of Vh(x*) are linearly independent). Suppose in addition that 

VL(x*) = and y'V 2 L(x*)y > 

where yVh(x*) = 0, A are the Lagrange parameters and L is the lagrangian function defined 

as L = U + Ah. 

x* is a solution of problem [5] 

C. Examples 

We present some cases - unconstrained optimization, duality theory - in which both theories 
are linked. The following example in is the starting point of this research. 

Example ILL: Consider a gradient autonomous system x = — VU (x), contracting in an identity metric, = J. 
As it is autonomous and contracting in a time independent metric, it has a unique equilibrium point because 

1(VC/) = F(VC/) 
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which implies exponential convergence of x to zero, x converges to a constant, x*. This point has zero speed, 
V£7(x*) = 0. The condition of contraction at this equilibrium point is the positive definiteness of V 2 £/(x*). 
These are the two sufficient conditions (theorem [2]) to prove that x* is a solution to problem [2] 

Contraction theory is also related to differential geometry through example |IL2[ lfT9l 



Example II.2.: The condition of contraction of the system [T] for a positive definite metric g = 0'0 that verifies 
a parallel propagation is that the hermitian part of 

'df(x,t) 



F = 0L>f(x,t)0- 1 =0 



dx 



£it,.r(x,^ e- 1 



has a uniformly negative maximum eigenvalue. D is the covariant derivative and the Christoffel term is defined 

. A< V V k m , — 1 ( d 9n _l Mi _ d 9ij \ 
db l^k L ijykl — 2\dq0 dq i dq l r 

The idea is to use a parallel propagation of the tensor 0, fT9l . 



The geometric interpretation of the covariant derivative is the projection of the directional 
derivative on that submanifold, thus the tangential part of the directional derivative. It can 
be written as: 

D X Y = (d x Y) tan9 = d x Y- < d x Y, v>v 

where d x Y is the directional derivative along the X direction and v is the normal vector to the 
submanifold. 

When writing Sz = ©.Df© -1 ^, it means that the virtual speed is constrained to belong to 
'some' manifold. This idea of projection is fundamental to prove contraction for constrained 
dynamical systems. 



With example [ILT| we show that contraction and unconstrained optimization are linked through 
gradient systems. Another important domain in optimization is duality. It is very useful to use 
the dual formulation instead of the primal for a variety of reasons. Sometimes the dual problem 
has a closed form solution or the algorithm to find the minimum is much faster. In example |II.3[ 
we show that contraction and duality are related using gradient systems. 

The Legendre transformation is defined as follows for y e R n : 

U*(y) = sup^ Rn (x / y-U(x)) (4) 
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The conjugate function U* is a convex function since it is the pointwise supremum of linear 
functions. 

Example H.3.: The system x = — VZ7(x) is contracting for the identity metric and also smooth (existence of 
derivatives) if and only if the system y = — VE/*(y) is contracting for the identity metric and also smooth. 
To prove the if part we use the fact that strict convexity and smoothness are dual properties, [23]. 
For the only if part, we apply the first part of the proof to the function U*. We use the fact that as U* convex, 
close (the domain of U is closed) and proper (it never takes the value — oo and the set dom g = [x\g(x) < oo] 
is nonempty), = U 

In O combination properties of contracting systems are of great importance. In example |IL4 
we derive a new result that cannot be achieved with classical minimization theory. 

Example H.4.: If there are two unconstrained minimizations which have respectively their minimum at x\ and 
x% 9 the sum of both cost functions may not have a minimum. Using only classical minimizations theorems we 
cannot conclude anything when summing both systems. 

If the gradient systems issued from the two precedent minimization problems are contracting, the sum of the 
gradient systems, is still contracting. Therefore the sum of the two cost functions has a minimum 

In the following all the points are regular. This means that Vh(x)Vh / (x) has full rank and 
hence is invertible. That is the only hypothesis needed in the following analysis. 

III. Contraction theory with equality constraints 
A. Starting on the constraints: contraction theory 

We define the sets S = [x / h(x) = 0] and M(x) = [y / yVh(x) = 0]. S is the space of the 
constraints. M is the tangent subspace of h at point x, it is a k-submanifold. (a k submanifold 
is defined as Vh(x) having full rank using the implicit function theorem). 

We define the operator H 

P(x) = 1 - Vh / (x)[Vh(x)Vh(x) / ]- 1 Vh(x) 

It is a symmetric orthogonal projection operator onto M(x) because it verifies P(x)P(x) = P(x) 
and P(x)y e M(x). 
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1) Contraction theorem : 

Theorem 4. The condition of contraction of the constrained dynamic system 

x = f(x,i) s.t. h(x) = 
is that there exists a metric, 0, uniformly positive definite and that the hermitian part of : 



has a maximum eigenvalue uniformly negative. P(x) is the projection operator onto the tan- 
gent space M(x) and A(x, t) — f (x, t)Vh / [VhVh / ] _1 . The initial condition must verify the 
constraint. 

The proof has three parts. We project the system by adding a term related to the Lagrange 
parameters. We compute the condition of contraction of this new system.Finally, we prove 
contraction behavior. 

The initial problem is 



Physically f is the velocity of the system going away from the constraints. To verify the 
constraints, the systems's velocity has to be tangent to the constraints at x. We project the 
system onto M(x) using the projector P(x). 



We note A(x, t) = -/(x,t)Vh / (x)[Vh(x)Vh(x) / ] _1 . These are not exactly the Lagrange pa- 
rameters. But if f = VU (x), we recognize the Lagrange parameters. This is a first generalization 
of the Lagrange parameters. The new dynamical system is x = VC/(x) + A(x)Vh(x) = VL(x) 
where L is the usual Lagrangian function. In the following the projected system will be known 
as Lagrangian dynamics. This result gives a new insight about Lagrange parameters. The term 
A(x, t)Vh(x) is a reaction force allowing the system to stay on the constraints. A Lagrange 
parameter is the scalar value that gives the magnitude of the force along the orthogonal direction 
to a particular constraint in order to have a tangential speed. Lagrange parameters as reaction 
forces has already been investigated using the Lagrange equation (61 0. Anytime, the constraints 
are verified because the system starts on the constraints and the velocity is tangential to the 
constraints. If initially the constraints were not verified, this property would not be true. 
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A(x)V/i(x) 



Fig. 1. Projected speed of the dynamic system 



We consider a virtual displacement 5x and a positive definite metric, 0(x, t). The function 
5x'©(x, i)'0(x, i)5x is the distance associated to the first fundamental form of the k-submanifold 
M(x). We define 5z = 0(x,*)5x. 

We compute ^(Sz'Sz) = 28z , 8z. We calculate Sz = 0(x, i)5x + 0(x, i)5x where 5x = 



(g+A(x,*)0+^i)fe 



We compute a long calculation aA ^'^ . This is done in [4] and [8j. 

Sic = P(x) + A(x,t)0) «5x - Vh(x)'[Vh(x)Vh(x)']- 1 &0x (5) 
The first term belongs to M(x), the second term to M(x)^. The equation can be rewritten : 

5x = 5x" + Sit 1 - 

In order to have contraction behavior the first term of 5x" must be uniformly bounded. Finally 

f t (Sz'8z) = 28z' (e(x, + 0(x, t)P(x) ^ + A(x, ) 0(x, t^Sz 



Example III.l.: The major goal of control theory is to find the control input that will make the system behave 
in a defined way. In mathematical terms, find u such that 

x = f (x, t) + u(x, t) 
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has a specific behavior. In the case of projected contraction theory identifying u(x, t) — AVh, we find a control 
that makes the system evolve on the constraint. 

The following example shows how projected contraction can be applied to general dynamic 

systems (not only to gradient systems, i.e. minimization problems). 



Example III.2. : The system [6] arises from the study of a mathematical model for the spread of an infectious 
disease in a population with a fixed total size. The variables s, e, i, and r represent fractions of the population 
that are susceptible, exposed (in the latent period), infectious, and recovered, respectively. All parameters are 
assumed to be nonnegative, we assume also e > and 7 > 0. 

s = b — bs — Xis + ais + Sr 
e = Xis — (e + b)e + aie 

9 (6) 

i = ee — (7 + a + b)i + ai 
r = 72 — (b + S)r + air 

The biological feasible region is the following invariant simplex s + e + i + r = 1, the sum of the different 
populations is the total population. We project the dynamic system. The value of A = — fVh'\S7hVh']~ l = 
— \{b — bs + ais — be + aie — (a + b)i + ai 2 — br + air). The jacobian of the system is: 



df_ 

dx 



\ 



-b — Xi + ai (—A + a)s S 

Xi —(e + b)+ai Xs + ai 

e -(7 + a + 6) + m 

ae 



The projection matrix is : 



/ 



P = l - V/i'(x)[V/i(x)V/i(x)']- 1 V/i(x) = 



V 







"(& + 


-*H 


3 


-1 


-1 


-1 


-1 


3 


-1 


-1 


-1 


-1 


3 


-1 


-1 


-1 


-1 


3 



/ 



On figure |2], the system converges to x* = [0.050,0.542,0.193,0.213]. This equilibrium point corresponds to 
an endemic population. The condition of contraction has to be calculated for a metric, 9(x). In this case the 
metric is the complex matrix that diagonalizes the jacobian times the projection matrix. 

F = 9(x)P^6(x)- 1 

ax 

We do not have AV 2 h in the contraction condition because the constraint is linear. There is just one eigenvalue 
that is equal to zero. We get rid of it by using a three times four projection matrix. The vectors of this matrix 
are a basis for M. Using the interlacing theorem, the eigenvalues of the projected matrix are all negative, the 
system is contracting. 
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Eigenvectors 



o.o r ... i ... i ... i ... i . . 

0.000 0.005 0.010 0.015 0.020 0.025 



-4oi ... r. i . i . .. i ... i . . 

0.000 0.005 0.010 0.015 0.020 0.025 



Fig. 2. Projected speed of the dynamic system 



2) An algorithm for solving minimization problems: As shown in example [Il7T| an autonomous 
contracting dynamic system has a unique equilibrium point x*. 



± = - W(x) s.t. h(x) = 



(7) 



The projected system, which we call Lagrangian dynamic, is x = — VL(x). It verifies VL(x*) = 
0. The dynamic system also satisfies the constraint h(x*) = because we start on the constraint 
and the speed of the system is always tangential to the constraints. These two conditions ensure 
us that at anytime h(x) = 0. 

The system being autonomous, the condition of contraction is, [4] 

x = -P(x)V 2 L(x)i 

As x e M(x), we have : x = P(x)x. Thus: x = — P(x)V 2 L(x)P(x)x. The condition of 
contraction is 

x*'P'(x*) (0 + A(x*)|^ P(x*)x* = y'V 2 L(x*)y > rj > 



dx 2 



with y = xP(x*) G M(x*) by definition of P(x*). 
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These are the three conditions for the existence of a minimum to problem |3j This is a new 
relationship between minimization and dynamical systems using contraction theory. This has 
been investigated ||9| . 

This idea of projection creates a new dynamical system. It is a new way of solving minimiza- 
tion problems. We give some examples. The first one is done in great detail. 

Example III.3.: The minimization of the length of a square in a circle is 

min x + y s.t. x 2 + y 2 = 1 

The gradient dynamical associated is x = —V/ = f ] s.t. x 2 + y 2 = 1. After projection 

V- 1 / 

-1 + x 2 + xy 
-1 + y 2 + xy 

where A = — = The eigenvalue of F is x + 2/. The system is contracting in x + 2/ < 0. As the 

system approaches the solution, A — > A*. Figure [3] shows that the dynamic system always stays on the constraint 
while it goes to the minimum. 

Example III.4.: Consider the minimum distance from a point to a sphere problem 

min ^(x 2 +y 2 + (2 - 2) 2 ) s.t. h(a:) = x 2 + y 2 + £ 2 - 1 = 

The evident solution of this problem is the projection of the point (0, 0, 2) on the sphere: (0, 0, 1). The projected 
system is: 



x = W + AVh = 



( x + Ax ^ 
y z - 2 + A^ J 



with X = 2z -1. 

On figure [4] , the system evolves on the constraint, it converges towards the expected solution. 

Example III.5.: The minimum distance from a point to an ellipse is chosen to show that the lack of symmetry 
does not prevent convergence of the algorithm. We search the distance from a point to the ellipse. 

min i||x-xi|| 2 s.t. /i(x) = ^ + ^ + ^-1 = 
2 a z b z c z 

Consider a = 15;6 = 5;c = 3; and the absolute minimum being 1, 4, 2. On figure [5] the solution corresponds to 

the projection of the absolute minimum on the ellipsoid. (The red dotted line just indicates where the projection 

point is). As usual the convergence's speed is very fast compared to matlab. 
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Example III.6.: The minimization problem with two constraints 

ram-||x — xi|| 2 s.t. hi(x) = | |x| | 2 — 1 = /^(x) = x + y + z = 

The absolute minimum is 1,4,2. The starting point has to verify both constraints are verified : [0, 4=, — 4=]. 
The dynamical system follows both constraints. Each Lagrange parameter acts as a force making the dynamical 
system to stay on the corresponding constraint. The final point is the double projection of the absolute minimum, 
figure [6] 

Example III.7.: Consider the minimization on a torus 

rain x s.t. ft(x) = (R - \/x 2 + y 2 ) 2 + z 2 - r 2 = 

The minimum on the torus is on one of the sides. On figure [7], the system evolves on the constraint even if the 
shape of the surface is complicated. R corresponds to the outer radius and r corresponds to the inner radius. 
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1. 



0. 



-0. 
1 

0.5 


-0.5 

^ n ' | | I I 

1 0.5 -0.5 -1 

Fig. 4. Minimum distance from a point to a sphere 

B. Starting outside the constraints: sliding behavior 

1 ) The problem and intuition of the solution: The biggest limitation of this problem is to 
have to start on the constraints. One solution is to add the following dynamic. 

- y^c^(x)v^(x) 

i 

Ci is a constant that gives the speed of approach to the constraint i. V/i^(x) gives the direction 
that is normal to the surface locally and —hi(x) gives a sense to this direction, figure [8] . A 
priori, this property is local because far away from the surface the term in V/^ is not necessarily 
normal to the surface. Consider the modified dynamic system: 

x = /(x,t) + AV/i(x) - ^c j /i j (x)V/i j (x) 

3 
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Fig. 5. Dynamical system on the ellipsoid, starting point is 6.7, —2.5, 2.2 



In an autonomous gradient system, 

i = -V([/(x) + Aft(x) + lYl c ^?( x )) = " VL c 

j 

This term corresponds to the term that is added in optimization to construct the augmented 
lagrangian, L c . It can be understood as adding a cost when the constraints are not verified. 

2) Sliding surface behavior: In this section we prove that converging to the surface when 
starting away from is a global property. We use sliding control techniques. We define s = 
|(Si c ^?( x )) where q > 0. s is by definition non negative. Its derivative is 

i 

Because /(x, i)P(x) e M(x), V/^(x)/(x, £)P(x) = 0. The derivative is equal to : 
ds 

— = -^Q^(x)V^(x)(^c i /i i (x)V/i i (x)) = -(^c^V/i,) 2 < 

i 3 

If s is bounded, we apply Barbalat's lemma lfT3ll . ^q/^V/^ converges to zero as time goes 
to infinity. Using the initial hypothesis, V/^ are linearly independent, q/^ goes to zero. The 
constraints are verified. The technique used here is a very common technique in nonlinear 
control theory, h 2 can be seen as the distance to the surface, which is the same as the sliding 
variable s used in nonlinear control. 
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Fig. 6. Example of minimization with two constraints 



With one constraint we get exponential convergence towards the surface. 

= ft(x)Vft(x)x = -c/i 2 (x)(V/i(x)) 2 

There are two dynamics in this augmented system. These two dynamics can be controlled using 
the c parameter. The first dynamic is the so called, Lagrangian dynamics. This dynamic leads 
to the minimum once on the surface. The second dynamic is the so called sliding dynamics. 
It makes the system converge to the constraints. If the value of c is very big, we give more 
importance to the sliding term. If c is small, it will take longer to converge. 
3) Examples: 

Example III.8.: Consider the optimization problem 

min x + y s.t. x 2 + y 2 = 1 
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Fig. 7. Minimization on a torus 



Cjhj{x)Vhj{x) 




Cjhj{x)Vhj{x) 



h(x)<0 



h(x)>0 



Fig. 8. Sliding dynamic 



The projected system is: 



-l+^-c(x 2 + y 2 -l)x 



c(x 2 +y 2 - l)y 



x -\-xy 
2 +xy „(^2 _l „,2 



x 2 -\-y 2 



If c is small, (figure [9]) initially the system follows the Lagrangian dynamic, (it follows a circle that is situated at 
the starting position). As the system goes away from the surface, the sliding dynamic becomes more important. 
If c is big, the system converges very quickly to the surface. Once on the surface the Lagrangian dynamic makes 
the system to evolve on the constraint towards the minimum. The best trade off is to choose a middle value 
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circle 

— Trajectory with c=1 
Trajectory with c=10 
Trajectory with c=.1 
Minimum point 




-0.5 0.5 1 1.5 2 

Fig. 9. Minimization of the length of a square in a circle 



(c=l). We approach the surface following the shape of the constraint. The number ^ can be seen as the radius 
at which the lagrangian dynamics starts working. 



Example III.9.: Minimum distance from a point to a sphere Consider the minimization problem, distance from 
a point to a sphere, 

1 



min ^(x 2 + y 2 + (z - 2) 2 ) s.t. h(x) = x 2 + y 2 + z 2 - 1 = 
The solution is (0, 0, 1). The projected system adding the sliding term is: 



x = W + AVft 



( x + \x + c(x 2 + y 2 + - l)x ^ 

y + \y + c(x 2 +y 2 + z 2 — l)y 
y z-2 + \z + c(x 2 +y 2 + z 2 - l)z J 



with A 



2z-l 
x 2 -\-y 2 -\-z 2 ' 



Example III. 10.: The problem is to maximize the volume of a parrallelepiped staying on an ellipse 

2 2 2 

min — xyz s.t. nix) = + 777 H — ~ — 1 = 

a z b z c z 
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Fig. 10. Minimum distance from a point to a sphere 



Consider a = 15; b = 5; c = 3;. figure 11 shows the convergence. 



Example III.ll.: The minimization problem with two constraints 

min ^||x — xi|| 2 s.t. fti(x) = ||x|| 2 — 1 = /^(x) = x + y + z = 

The final point is the double projection of the absolute minimum. The values c±,C2 are the gains to the two 
surfaces. To stay on the sphere, we increase the gain (c\ = 10). 

IV. Contraction theory with time-varying equality constraints 

This section has two main parts. In the first one, we state a theorem giving the condition of 
contraction for a time varying constrained nonlinear dynamic system. We start on the constraints 
to have contraction behavior. In the second part, we allow the system to start outside the 
constraints. We use sliding techniques to conclude convergence to the constraints. 
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Fig. 1 1 . Maximum volume on an ellipse 



A. Starting on the constraints: contraction theory 
We define the set S(x,t) = [x / h(x,£) = 0]. 

1 ) Contraction theorem: In this section we compute the condition of contraction for dynamic 
systems under time-varying constraints. 

Theorem 5. The condition of contraction for the system 

x = f(x,£) s.t. h(x,t) = 

is that there exists a uniform positive definite metric; and that the hermitian part of : 

F = ^e(x,t) + 0(x,t)P(x)^ + A(x,t)^^^e(x,t)- 1 onS(x,t) 

has a maximum eigenvalue uniformly negative. P(x) is the projection operator onto the tangent 
space 5(x, t) and A(x, t) = — (f (x, t)Vh + ^)[VhVh / ] _1 . The initial condition must verify the 
constraint. 

The proof has three parts. The initial problem is 

x = f(x,t) s.t. /i(x,t) = 
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Fig. 12. Example of minimization with two constraints 



Physically to remain on the constraints, we need to project the speed and consider the surface's 



speed, figure [13] This last term is calculated because the constraints are always verified, = 
^ = Vhx f + H As we have the choice on x\ we add a term to ensure that this equation is 
verified. 

dh 

- — [VhVh'l^Vh = A,Vh 

ot 

We can see this new parameter as a force that makes the system stay on the constraint. It is a 
new generalization of Lagrange parameters. The total system is: 

x = f (x, t) + Ai Vh - — [VhVh 7 ]- 1 Vh = f (x, t) + Ai Vh + A t Vh = f(x, t) + AVh 

where A = Ai + X t . The constraints are verified at anytime because the system starts on the 
constraint and the velocity remains on the constraints. 
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t+dt 



X 



f + X L Vh 



Fig. 13. Projection with time-varying constraints 

We compute 5± = (g + A(x)0 + + ^^l) <5x. can be computed as well 

ax 

We can substitute in the precedent equation and reorganize: 

5x = p(x) {%. + A(x) 0) * x - wtvMxwr 1 (*x0 x + f ) 

It is essential to note that the first term belongs to M(x) and the second term belongs to M(x)- 1 . 
To have contraction behavior the first term of 5x1 1 must be uniformly bounded. 

*x = P(x)(g + A<*)0U 



■(fe'fe) = 2fe' (e(x, t) + e<x, t)p(x) (QL + x(x)^\ ) e(x, jj-'fe 



Finally 

d 

2 J Theorem's applications: One of the most important application is optimization under 
varying constraints. 

Example IV.l.: The problem of the sum of the sides under a growing circle is : 

min x + y s.t. x 2 + y 2 = t 2 
The solution using KKT theorem, p| is given by x* = y* = — Using the precedent theorem we create the 



'extended' lagrangian system, simulated on figure 14 



x = 



i _ {x+y) _ x 

1 t 2 X t 

1 _ {x+y) _ y 

1 t 2 y t 
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The condition of contraction is V 2 / + (Ai + A £ )V 2 /i = - x+ ^ 2 +t I > 0. The final condition is x + y + t < 0. 




Fig. 14. Minimization of the sum of the sides under a growing circle 



Example IV.2.: The problem of the sum of the sides under a growing ellipse is : 

min x + y s.t. tx 2 + y 2 = 1 



The solution using KKT theorem, |3j is given by x* = —-j==, 



2f 



1 _ (^+2/) _ x 2 
L t 2 x 2 +y 2blL 2t 2 x 2 +2y 2 

i _ (jg±y) ?/ _ x 2 

L t 2 x 2 +y 2 y 2t 2 x 2 +2y 2 

The condition of contraction is given by V 2 / + (Ai + A £ )V 2 /i ~ t^ffl ^ > 0. The final condition is 

x 2 + tx + 2/ < 0. 

In this example; we use time varying constraints to solve problems with static constraints. 



t 


Vi+t 2 ' 


xt ^ 




y ) 




x 2 +tx+y 


t 2 x 2 


+y 2 



Example IV.3.: In order to make a smoother approach to a certain constraint ho, we can create a time varying 
constraint such that when t —> oo, h(x,t) — > ho(x). Consider the minimization problem: 

2 2- 

min x + y s.t. x -\- y =e* 
The dynamical system associated to that is : 
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Fig. 15. Minimization of the sum of the sides under a growing ellipse 



(g±y) ~ a; 

e * 

( x +y) „. y 

e t 



B. Starting outside the constraints: sliding behavior 

1) Sliding surface behavior: As done in the precedent chapter, we add a sliding term. The 
new system is : 

dh 

x = f(x,t) + AVh - — [VhVh'^Vh -^cjh^Vh^x) 

3 

We have global convergence towards the surface. We define s = \i^ Ji where q > 0. s 

is by definition strictly positive. Its derivative: 

ds = c>h> ( + dh 



dt \dx dt 

C'h! ( g (p(x)'f(x, t)> - Vh'tVhVh']" 1 ^ - £ cMx)Vhj(x) ) + ^ 
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Fig. 16. Using time varying constraints to solve problems with static constraints 



Because f(x,t)P(x) G M(x), V^(x)f (x, t)P(x) = 0. As VhVh^VhVh 7 ]-^ = §. The 
derivative is 

^ = -(^c^V/i,) 2 <0 

The second derivative is smooth, it is bounded. Applying Barbalat's lemma, we conclude that 
^ CihiVhi converges to zero as time goes to infinity. As V/^ are linearly independent, q/^ goes 
to zero. The constraints are verified. 

2) Examples: To show how this sliding term works, we use the precedent examples but 
starting on a point outside the surface. 

Example IV.4.: Minimization of the sum of the sides under a growing circle The problem is : 



The new system is 



min x + y s.t. x 2 + y 2 = t 2 



l-g$x-1+chx 
l-g&V-S+chy 
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Fig. 17. Minimization of the sum of the sides under a growing circle 



Example IV.5.: Minimization of the sum of the sides under a growing ellipse The problem is : 

min x + y s.t. tx 2 + y 2 = 1 



The new system is 

x = — \ 



1 t 2 x 2+y 2 tX 2t 2 x 2 +2y 2 xt + C ^ X ^ 



V. Conclusion and directions for future research 
This research has four main new contributions. 

- The first and more important is the condition of contraction (a condition of convergence) 
for two different dynamic systems, constrained with equalities and constrained with time 
varying inequalities. 

- The second contribution is, in the particular case of a gradient autonomous contracting in 
a metric identity system, an algorithm to find the minimum. A more general metric could 
allow solving more complicated problems. 

- The third contribution is the understanding that adding a term ^ in the cost function 
corresponds to dynamic term that makes the dynamic system converge towards the surface. 
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2.5 




Fig. 18. Minimization of the sum of the sides under a growing ellipse 

- The fourth and last contribution is on Lagrange parameters. This paper gives a new physical 
approach of Lagrange parameters. They can be understood as a scalar value that ensure the 
system to have a tangential speed to the constraints. Also it gives three generalizations of 
Lagrange parameters, with a time varying cost function A = — V£7(x, t)V/i / [V/iV/i / ]" 1 , 
with a time varying general vector A = — f (x, t)Vh , [VhVh , ]~ 1 and with a a time varying 
general vector with time varying constraints A = — (f (x, t)Vh! + [VW/z/] -1 . This last 
case is the most general because it contains the other two. 

There are many directions for the future research. 

- We have always used an identity metric. It is interesting to explore what happens with 
constant metrics and time varying metrics. In the gradient autonomous case, it could include 
some information of the constraints making the minimization faster. 

- When having many different goals, Pareto optimality does not have a general theorem to 
find the best solution. May be some conclusive theorem can be found exploring Pareto 
optimality using contraction theory. Contraction theory has very interesting combination 
properties. 

- In chapter one, an example using parallel combination has been presented. We could try to 
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use feedback and hierarchical combination. 

- The Hamilton- Jacobi-Bellman (HJB) equation is a partial differential equation which is 
central to optimal control theory. It is the solution of a minimization problem subject to a 
dynamic system. 

- In the article [20J , the ordinary gradient of a function does not represent its steepest direction, 
but the natural gradient does. Information geometry is used for calculating the natural 
gradients. How does this natural gradient relates to our projection operator ?. 
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